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I.   INTRODUCTION 


Often,  in  the  design  and  production  of  complex  systems, 
an  important  question  to  be  answered  early  in  the  process 
concerns  the  demonstrable  system  reliability  based  upon 
observed  mission  test  results.  Usually  only  components  and 
minor  subassemblies  can  be  tested  in  any  but  the  very  latest 
stages  of  production.  For  reasons  of  prototype  cost,  the 
lack  of  complete  systems  for  early  tests,  the  expense 
involved  in  total  system  operational  tests,  and  the  need  to 
make  production  decisions  as  early  as  feasible,  reliance 
must  be  shifted  to  the  component  test  results  to  provide  at 
least  an  approximate  answer  to  this  question.  Component 
data  must  be  used  in  spite  of  the  moderately  strong 
assumptions  needed  to  transform  such  test  results  into  an 
estimate  of  overall  system  reliability. 

Since  estimates  are,  by  their  nature,  inexact,  it  would 
be  reasonable  to  expect  that  the  most  credible  estimate 
would  be  one  which  was  both  conservative  and  carried  with  it 
an  indicator  of  the  degree  of  conservatism  associated  with 
its  computation.  This,  of  course,  is  a  description  fitting 
a  lower  confidence  limit  when  referring  to  estimates  of 
system  reliability.  Thus,  when  one  speaks  of  a  " 100(1-a)% 
lower  confidence  limit"  and  obtains  a  value  for  it,  the 
assertion  is  that  the  obtained  lower  confidence  limit  value 
is  less  than  the  actual  system  reliability  with  probability 
1-a. 

In  1968,  J.  R.  Borsting  and  W.  M.  Woods  developed  what 
is  known  as  the  Log-Gamma  method  for  computing  lower 
confidence   limits   for    system   reliability   based   upon 


component  mission  test  results  only  [Ref.  1  ].  As  originally 
developed,  the  Log--Gamma  method  was  restricted  to  systems 
composed  of  all  series  connected  components.  It  did, 
however,  offer  the  advantage  of  allowing  for  unequal  sample 
sizes,  so  the  number  of  component  tests  could  vary 
arbitrarily  from  component  to  component  without  degrading 
the  procedure  accuracy.  In  addition,  no  assumption  is 
needed  concerning  the  failure  distribution  of  any  component. 

Woods  has  recently  proposed  a  modification  to  the 
procedure  which,  it  was  hoped,  would  extend  its  application 
to  a  mixed  system  of  series  and  parallel  connected 
components.  The  purpose  of  this  study  is  to  assess  the 
accuracy  of  the  revised  procedure  when  applied  to  some 
typical  component  failure  data  from  several  representative 
series  and  series- parallel  systems.  An  attempt  is  also  made 
to  discern  parameters  (constructed  from  or  inherent  to  the 
sample  data,  component  reliability  goals,  testing  plan,  and 
system  design)  which  could  provide  useful  indicators  of  the 
expected  accuracy  of  the  procedure. 


II.   THE  PROCEDURAL  MODEL 


It  should  be  noted  that  two  rather  strong  assumptions 
need  to  be  made  with  respect  to  system  and  component 
reliabilities.  First,  it  must  be  assumed  that  component 
tests  were  conducted  in  a  test  environment  not  unlike  that 
encountered  in  the  system  operational  mission  environment 
profile.  Second,  no  component  reliability  degradation  will 
result  from  interactions  with  other  components  when 
assembled  into  the  system.  The  degree  to  which  these  two 
assumptions  are  met  will  have  an  unknown  but  potentially 
great  effect  upon  the  validity  of  the  model  and  indeed  upon 
the  whole  concept  of  system  reliability  prediction  from 
component  attributes  data. 


A.   DEVELOPMENT  FOR  SERIES  SYSTEMS 


This  section  gives  a  modified  and  elaborated  development 
of  the  basic  reliability  model  and  estimation  procedure 
based  upon  that  presented  by  Woods  and  Borsting  [Ref.  1]. 

For  a  system  of  k  components  in  logical  series,  the 
system  reliability,  Rs,  can  be  expressed  in  terms  of  the 
individual  component  reliabilities  as  the  product 

Rs  =   n  Pi  (2.  1) 

i=1 

where  Pi  is  the  true   reliability   of   the   i-th   component. 
From  Pi  the  component  unreliability,  Qi,  is  defined  as 


Qi  =  1-Pi. 

Taking   the   natural   logarithm   in   equation   (2. 1)  and 
defining  the  new  variable,  5: 

k 
S  =  -InBs  =  -  z  ln(1-Qi)  (2.2) 

i=1 

The  natural  logarithm  can  be  expanded  by  the  infinite  series 
In  (1-X)  =  -  I     (X)/j     for  0<X<1 

S  =   Z    l     (Qi?/j  (2.3) 

1=1  3=1 

k 
S    =      I   [  Qi    +   Qi2/2    +   Qi3/3    +    ...  ] 
i=1 

For  Qi  small,  say  0.1  or  less,  the  above  series  may  be 
approximated  by  the  first  two  terms  with  a  maximum  error  of 
0.34%   of    the   true    value.      Thus, 

k  k 

S    =       E  [Qi    +    Qi2/2]   =      E    Ti  (2.4) 

i=1  i=1 

where  Ti   =   Qi      +      Qi2/2.         For      the      remainder      of      the 

derivation   this   approximation    is    treated   as   an   equality. 


Appendix   A   derives   an   unbiased   estimator,    Ti,    for    Ti: 

Ti   =   AiQi    +    Bi[Qi2]/2  (2.5) 

where  Ai   =   [ 2Ni-3  ]/[ 2Ni-2  ] 

Bi   =    Ni/[Ni-1 ] 

Qi  =  Fi/Ni 
and,       Fi  is  the  number  of  failures  resulting  from  Ni 

mission  tests  conducted  on  the  i-th  component. 

An  unbiased  estimator  of  S  will  be  obtained  from 
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S  =   z  Ti 
i=1 


(2.6) 


S  will  be  an  unbiased  estimator  of  S,  since  it  is  the  sum  of 
the  unbiased  estimators,  Ti,  of  Ti. 


Appendix  B  shows  that,  for  the  reasonably  expected  range 
of  values  for  Qi  and  Ni,  the  variance  of  S  may  be 
approximated 


Jc  k 

Var[S]  ■   E  Var[Ti]  ±  z   [  Ti/Ni  ] 
i=1  i=1 


(2.7) 


By  intuitively  assuming  the  probability  distribution  of 
S  is  of  the  gamma  type  with  parameters  r  and  9,  an 
expression   can  be  derived  for  a  confidence  interval  for  Rs. 

The  gamma  probability  density  may  be  written  as 


/ 


f„(x,r,9)  = 
S 


1     r-1  -x/9 
x   e 


p   r  x>0 

i(F)-e 


(2.8) 


x<0 


with  mean  =  r9  and  variance  ■  r92. 


To   determine   the   values   of   r   and  9,    the  following 
relationships  are  established: 


E[S]  =  r9 


from  Eg.  (2.8) 


E[  §]  =   E   Ti   from  Eg.  (2.H) 
i  =  1 


Var[S]  =  r$2    from  Eg.  (2.8) 

k  Ti 

Var[S]  =  .  z  — 

i=1  Ni 


These   eguations   may   be  solved  simultaneously  to  yield  the 
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following  expressions  for  r  and  0: 


E    Ti 
i  =  1 

2 

dnd 

9 

k      Ti 

E      — 

i=1    Ni 

k      Ti 

E       

i=1    Ni 

k 

E    Ti 
i  =  1 

r  = 


and  an  estimator,  r,  for  r  would  be 

2 


I  k 
E  Ti 

i=1 


r  = 


k   Ti 

E   — 

i=1  Ni 


(2.9) 


Note  that  for  S  distributed  as  gamma  (r,0),  2S/0  will  be 
distributed  as  chi-sguare  with  2r  degrees  of  freedom  [Ref. 
2,  p.  181].  The  following  probability  statements  can  then 
be  made: 


[    0   /\-2r,1-otJ 


(2. 10) 


1-a   =  P 


Since      e      =      E[S]/r      from      Eg.     (2.8)       and      E[S]   =    -InRs   from 
Eg.     (2.2), 

"-InRs  2S 

1-a      =    PI < 


I -In] 


2 

2r, 1-a 


r  ~2rs  i 

1-a      =    P    InRs    <   

1  ^2r,1-a    * 


Thus   the   100(1-  a)%   lower  confidence  limit,  Rs*<a),  for  Rs 
is 


Bs*<a)  =  exp 


I53..1-] 


(2.11) 
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A  100  (1-a  )%  lower  confidence  limit  estimate,  Rs*< a> ,  for  Rs 
would  be 


Rs*Ca>  =  exp 


J\.2r 


-2rS   1 
.2r,  1-a 


(2. 12) 


The  primary  difficulty  this  formulation  presents  lies  in 
the  non-integer  nature  of  values  for  2r  as  defined. 
Although  some  computer  routines  are  available  to  approximate 
chi-square  values  with  non-integer  degrees  of  freedom,  most 
users  would  find  such  a  requirement  difficult  to  fulfill  at 
least.   Therefore  2r  is  replaced  with  the  expression 

[ 2r  ]  =  smallest  integer  >  2r 
This  is  justified  by  noting  that  the  ratio  of  the  chi-square 
value  divided  by  its  number  of  degrees  of  freedom  varies 
slowly  with  changes  in  the  degrees  of  freedom  for  values  of 
degrees  of  freedom  greater  than  about  five.  Further,  since 
2r  may  be  changed  moderately,  by  up  to  1.0,  without  great 
change   in   the  ratio  value,  it  is  reasonable  to  expect  that 

the  probability  distribution  of  [2rlA/  has   small 

^/U2r],1-a 

variance.    This  expression  can  be  subsittuted  into  equation 


(2. 12)  to  yield 

RS*<a>  =  exp 


-[2f]S   1 

,[22r],1-a  J 


(2.13) 


Since  the  computer  routines  available  for  this  research 
included  the  capability  of  computation  of  chi-square  values 
with  non-integer  degrees  of  freedom,  some  simulation  runs 
were  performed  using  both  equations  (2.12)  and  (2.13)  for 
comparison.  The  results  indicated  that  the  effects  were 
limited  to  the  third  decimal  place  at  worst  and  thus  had 
little  significance  with  respect  to  the  procedural  accuracy. 
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B.   REVISION  FOR  SERIES-PARALLEL  SYSTEM 


Proceding  from  the  strictly  series  system  procedure 
developed  above,  the  principal  revision  for  the  mixed 
series-parallel  system  procedure  was  to  redefine  fi  and  r  as 
follows: 


Fi      Fi2 

Ai —  +  Bi 

Ti  =  {       Ni     2Ni2 


lsif «/ ■ ai|Kl 


(1-Ri)  +  (1-Ri)2/2    i=K1+1,...,K2 


r  =  max 


1.0, 


"K1+K2    „    " 

2 

I         Ti 

i=1 

** 

K1+K2  Ti 
I         — 
i=1   Ni  J 


K1+K2  A 
S  =    i        Ti 
i=1 


(2.14) 


(2.15) 


(2.  16 


where    Ai  ,  Bi,  Fi,  and  Ni  are  defined  as  before 
K1  is  the  number  of  series  components 
K2  is  the  number  of  series-parallel   subassemblies 

interconnected  in  series 

Ri  is  the  reliability  point  estimate  for  the   i-th 

subassembly    determined    in   the   usual   manner   from   the 

individual  point  estimates  for  the  subassembly  components  as 

derived  from  the  raw  failure  data. 

Although  some  comparison  runs  were  made  using  Ai  and  Bi 
coefficients  for  the  subassembly  contribution  to  S,  no 
significant  improvement  in  accuracy  was  noted  and  the  use  of 
these  coefficients  in  this  manner  was  abandoned  due  to  the 
difficulty  of  computation  with  varying  sample  sizss  within  a 
subassembly. 
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C.   SPECIAL  CIRCUMSTANCES 


In  the  event  of  no  failures  in  any  components  or  a  lack 
of  sufficient  failures  in  subassembly  components  such  that 
the  basic  procedure  yields  an  S  value  of  zero  and,  thus,  a 
system  reliability  lower  confidence  limit  estimate  of  one, 
an  alternate  approach  must  be  employed. 

Statistically,  the  optimum  solution  might  be  to  continue 
testing  until  sufficient  component  failures  have  been 
observed  such  that  the  above  conditions  no  longer  exist. 
However,  such  a  solution  might  also  not  be  economically 
feasible.  Therefore,  the  sinulation  included  provision  for 
an  alternate  procedure  when  S  equals  zero  at  the  end  of  the 
programmed  number  of  tests  on  all  components.  In  addition, 
several  cases  were  included  where  such  conditions  would  be 
expected  to  exist  in  a  significant  number  of  the  simulation 
runs,  in  order  to  observe  the  efficacy  of  the  alternate 
procedure. 

The  derivation  of  this  alternate  procedure  is  given  in 
Appendix  C.   The  procedure  may  be  summarized  as  follows: 

(i)  Find  the  series  component  or  subassembly  with  the 
smallest  actual  or  equivalent  number  of  trials,  N  or  N', 
respectively.  (See  section  IV.B.1) 

(ii)  Change  the  number  of  component  or  subassembly 
failures  to  F'  by  the  following  scheme: 


NOTE:   For  best  results,  N  or 
N*  should  be  at  least  10. 


a 

F« 

0.2 

0.37 

0.  1 

0.25 

0.05 

0.16 
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If  a  subassembly  was  selected,  treat  the  subassembly  as  a 
component  with  F1  failures  out  of  N1  mission  trials  for  the 
remainder  of  this  procedure. 

(iii)  Recompute  the  lower  confidence  limit  estimate 
using  the  basic  log-gamma  procedure  with  the  revised  failure 
data.  This  estimate  is  approximately  equivalent  to  a  raised 
to  the  1/N  power  as  explained  in  Appendix  C. 
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III.   THE  SIMULATION 


A.   PROCEDURE 


The  computer  simulation  program  is  listed  in  Appendix  P. 
The  following  procedure  was  incorporated  into  the  program: 

Step  One:  Initialize  and  read  in  values  for  the  total 
number  of  components  in  series,  K1 ,  the  number  of 
subassemblies  in  series,  K2f  the  number  of  components  within 
each  subassembly,  the  number  of  tests  performed  upon  each 
component,  Ni,  the  true  reliability  of  each  component,  Ri, 
and  the  seed  value  for  the  random  number  generator. 

Step  Two:  For  each  component  in  turn,  generate  the 
observed  number  of  failures  as  a  binomially  distributed 
random  variable,  Fi,  with  parameters  Ni  and  (1-Ri) . 

Step  Three:  Compute  Ti  for  each  series  component  and 
subassembly,  S  from  the  sum  of  the  Ti,  and  r  according  to 
eguations  (2.14),  (2.15),  and  (2.16)  respectively. 

Step  four:  Compute  the  resulting  estimate  of  the 
100(1-  a)%  lower  confidence  limit,  R*<a>,  according  to 
eguation  (2.13)  for  representative  values  of  alpha  and  store 
each  estimate  in  a  vector  array  of  estimates.  Alpha  values 
used  in  this  study  were  0.20,  0.10,  and  0.05. 

Step  Five:  Repeat  Steps  Two  through  Four  until  the 
three  vector  arrays  of  estimates  corresponding  to  the   three 
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different  alpha  values  are  1000  values  in  length. 

Step  Six:  Order  the  elements  of  each  vector  array  from 
low  to  high  and  determine  the  sample  mean  and  standard 
deviation. 

Step  Seven:  Compute  the  true  system  reliability,  Rs, 
from  the  input  component  reliabilities. 

Step  Eight:  Extract  the  100  (1-a)  percentile  value  from 
the  corresponding  array  and  compare  with  the  true  system 
reliability.  If  the  estimation  procedure  is  accurate  these 
two  values  should  agree.  If  agreement  does  not  occur,  the 
differences  should  be  small,  preferably  conservative,  and, 
hopefully,  can  be  made  to  converge  toward  zero. 

Step  Nine:  Output  all  data  which  was  input  in  Step  One 
in  order  to  insure  against  input  error.  Output  starting  and 
ending  random  number  generator  seed  values.  Output  true 
system  reliability,  100  (1-a)  percentile  values,  differences 
from  true  reliability,  sample  means  and  standard  deviations, 
and  various  percentile  values  of  interest.  Provision  is 
made  in  the  program  for  output  of  all  of  the  sample  values 
both  before  and  after  ordering,  if  the  user  desires. 

Step  Four  was  performed  in  two  different  ways  for  four 
of  the  cases  where  there  was  a  high  frequency  of  runs 
without  failures,  called  'null  runs'  in  the  output.  The 
normal  way  of  handling  this  problem  was  to  discard  that  run 
data  and  repeat  it  from  step  one.  Thus  the  complete  arrays 
contained  estimates  from  only  those  runs  which  had 
sufficient  failures  for  the  procedure  to  be  valid  without 
the  special  circumstances  modification  discussed  in  Section 
II. C.  In  order  to  observe  the  effect  of  utilizing  the 
modification,  however,  cases  18  through  21  were  repeated  as 
cases   30   through   33   with  the  alternate  procedure  invoked 
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whenever  S  equalled  zero  at  the  end  of  step  three. 

Three  proprietary  routines  were  utilized  in  the  program 
and  are  therefore  not  reproduced  in  the  program  listing. 
These  routines  were  used  to  obtain  the  binomially 
distributed  random  variables,  the  chi-sguare  function 
values,  and  to  sort  the  estimate  arrays  [Ref.  4], 


B.   DESCRIPTION  OF  THE  CASES 


1 .   General 


The  cases  chosen  for  simulation  represent  three 
different  configurations;  a  series  of  components  connected 
in  series  with  a  series  of  simple  series-parallel 
subassemblies  of  components,  a  strictly  series-connected 
system  of  components,  and  a  system  which  incorporates  two 
somewhat  unusual  but  representative  "real-world"  subassembly 
reliability  relationships.  The  first  configuration  was 
chosen  to  demonstrate  the  general  performance  of  the  revised 
estimation  procedure  with  a  moderately  complex, 
series-parallel  system.  The  second  configuration  consisted 
primarily  of  some  cases  which  had  previously  been 
investigated  for  the  original  Log-gamma  procedure  [Ref.  1  ]. 
Since  the  revised  procedure  varied  somewhat  from  the 
originally  developed  version  in  the  treatment  of  the  wholly 
series  system,  a  comparison  was  desirable  in  order  to 
ascertain  whether  significant  effects  had  occurred  in  the 
procedure  accuracy.  The  third  configuration  was  chosen  to 
observe  the  robustness  of  the  procedure  when  applied  to  a 
much  more  complex  system  which  is  not  easily  reducable  to  a 
simpler  series-parallel  reliability  representation. 
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In  general,  the  simulated  number  of  tests  was  the 
same  for  each  component  within  each  case.  However,  this 
number  was  varied  among  cases  with  the  same  true  system 
reliability  in  order  to  identify  its  effect  upon  the 
procedure  accuracy.  The  two  exceptions  were  case  13  wherein 
the  number  of  tests  varied  from  component  to  component  and 
case  14  for  which  only  one  value  of  simulated  component 
tests  was  used  without  any  corresponding  cases  with 
different  numbers  of  tests. 

2.   Cases  One  Through  Twelve 


a.   Reliability  Block  Diagram 


-CUKEF 


•••    -    20 


21    -, 


22 


pi   23   |-f2^~]-|  |-|   27    -j^8~|-|~"29~|i 


b.   Test  Parameters 


(1)   Number  of  Component  Tests^  'Ni. 


Cases 

20 

01, 

04,    07, 

10 

X~~l/Z.^»»    •    /  O  »— 

02, 

05,    08, 

11 

50 

-L        i  0  *-  /  •   •    •    /  -3  £ 

03, 

06,    09, 

12 

100 

X.        1   f  £*  f  •   •    •    f  3  *L 

20 


(2)   !£!!£  System  and  Component  Reliabilities,  Rs 


and  Ri. 


Cases 

01,  02r  03 

04,  05,  06 

07,  08,  09 

10,  11,  12 


._Rs 

87559 

i 

79984 
79167 
72317 


,.Ri  , 

.  995 
.950 
.995 
.900 
".99  0 
.950 
".990 
.900 


i=1,2 
i=21  , 
i=1,2 
i=21, 
i  =  1  ,2 
i=21  , 
i=1,2 
i=21. 


.  ,20 
,32 
.  ,20 
,32 
.  ,20 
,32 
.,20 
,32 


3.   Case  Thirteen 


a.   Reliability  Block  Diagram 


rPT 


01 


02 


-Dei — m 


ri 


14 


15 


I—    16 


17 


_h 


-DD 


hzef 


b.      Test    Parameters 


i   _Ni 

_£i_ 

_i 

_Ni 

_Ri_ 

_i 

_Ni 

_Ri_ 

1   150 

.995 

7 

28 

.967 

13 

59 

.682 

2    90 

.985 

8 

125 

.995 

14 

5 

.729 

3    75 

.979 

9 

63 

.970 

15 

5 

.729 

4   100 

.988 

10 

125 

.995 

16 

5 

.729 

5   125 

.982 

11 

59 

.682 

17 

19 

.536 

6    18 

.980 

12 

59 

.682 

18 

19 

.536 

Rs:  0.72329 

19 

19 

.536 

21 


c.   Discussion 

This  case  corresponds  to  Case  No.  1  of  reference 
1.  The  only  change  was  to  replace  the  last  three  components 
each  with  three  components  in  parallel  with  a  subsystem 
reliability  equivalent  to  the  reliability  of  the  replaced 
component. 

4.   Cases  F2il£teeji  Through  Twenty- one  and  Thirty  Through 
Thirty-three 


Reliability  Block  Diagram 


wy. 


b.   Test  Parameters 


(1)   Number  of  Component  Testsx  Ni. 


Cases 

_Ni 

14 

20 

i=1,2,.. 

.  .  ,15 

15, 18,30 

25 

i=1,2,.. 

..,25 

16,17,31 

50 

i=1,2,.. 

..,25 

17,20,32 

100 

i=1,2,. 

..,25 

21,33 

200 

1-1,2,.. 

.  .,25 

22 


and  Ri. 


(2)   True  System  and  Component  Reliabilities,  Rs 


Cases 


14 


15,16,17 


Rs 


.79239  - 


88222 


18,19,20,211  .97530 
30,31,32,33] 


.995  i=1,2,...,14 

.850  i=15 

.995  i=1,2,...,25 

.999  i=1,2,...,25 


c.   Discussion 

These  cases  correspond  to  several  cases  from 
Ref.  1  with  the  exception  of  cases  21  and  33  of  the  present 
study.  These  were  added  when  it  was  noted  that  a  large 
number  of  runs  with  zero  failures  were  being  observed  with 
as  many  as  100  tests  on  each  component.  Cases  30  through  33 
are  identical  with  cases  18  through  21.  They  are  identified 
as  separate  cases,  since  a  slightly  different  procedure,  as 
described  in  section  III. A,  was  followed  in  their 
simulation. 
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5-      Cases   Twenty-two   Through   Twenty-nine 


a.   Reliability  Block  Diagram 


>-[  01   f-[~02~|-   •••   — |  20    - 


dEHZIH- 


LQuxuxn^  i^-^ 


,-    33    -, 


L    34    J 


In  logical  series  with 


38 


{ 


39 


ii 


35  [-[T6~]-  37  [^[~38~[-j-|  38  [■, 


35  -  3b 


HE\ 


-  44  i-« 


39 


t  + 


^-[ooXuT^. 


39 


+  + 


39  |— p"tTo~|— j  ai  U 


In  logical  series  with 


45 


46 


— —  •  •• 


59 


60 


b.   Test  Parameters 


(1)   Number  of  Component  Tests^  Ni. 


Cases 

_li 

22,26 

20 

i=1,2,. . .,60 

23,27 

25 

i=1,  2, ,60 

24,28 

50 

i=1,2, ,60 

25,29    100    i=1,2,...,60 
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(2)   I -US  System  and  Component  Reliabilities^  Rs 


and  Ri. 


_Cases_ 

22 

through 
29 


Rs 

(See 
below) 


_Ri 

r   .999  i=1,2,. . . ,26 

.886  i=27,28,. .. ,32 

<j  .900  i=33,34 

.999  i=35,36, ...  ,41 

..990  i=42, 43,44 


1  M=i-44 
22  to  25   .87306  (.995f  - 

i=45,46,.  .. ,60 


26  to  29   .83293  (.990?  - 


rj=i-44 


i=45,46,.  ..,60 


c.   Discussion 

The  second  and  third  subassembly  reliability 
diagrams  above  were  drawn  from  the  Lockheed  Reliability 
Evaluation  Plan  for  the-Trident  Missile  [Ref.  3], 

In  the  second  diagram,  component  44  and  both 
components  41  must  operate  successfully  for  system  success. 
An  additional  feature  of  this  design  is  the  capability  of 
obtaining  successful  functioning  of  component  44  by 
following  a  logical  path  through  component  39  and  continuing 
in  a  reverse  direction  to  reach  component  44  from  the 
opposite  side  of  the  diagram,  if  necessary.  This  capability 
is  illustrated  with  double  arrows  to  indicate  that  the 
logical  success  path  may  be  traced  in  either  direction  for 
that  portion  of  the  reliability  diagram.  Note  also  that 
identically  numbered  components  are,  in  fact,  separate 
components  but  identical  in  operation.  Therefore,  component 
test  results  for  a  particular  component  type  fire  assumed  to 
be  equally  applicable  to  all  components  of  that  type, 
regardless  of  the   specific   application.    The   reliability 
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equation   for   this   portion  of  the  diagram,  as  adapted  from 
reference  3,  is  as  follows: 


R 


SS 


=M    TTTLM   [1-  (1--M  )  (1-L  M  )  ] 

4ll2333L  X  1/V  Z      2       J 

+     (1-T    )L    L    L    T    M       [1    -     (1-M    )    (1-T    M    )   ]1 

1  1      2     3     3      3      L  X  2       V  2     1      JJ 

+    (1-M  )I"mmmttll     [1-    (1-r   )  (1-L  )  ] 

4C12323     2      3     L  X  l'    V  1 '    J 


+     (1-M    )     MMTTTLLL 

1  23123123 


j-     (.  +     (1-M    )     MMTTTLLL 

2  1312312      3J 


(3.1) 


where  T=RRRB  M=R 

1  35      363738  1  38 

i 

T       =    R     »  R  M       =    R 

2  38     39  2  4  3 

T=RRR  M=R 

3  39      4041  3  44 

L=RRRR  M=R 

1  35      3  6     4243  4  39 

L      =    R       R  L       =    T 

2  4339  33 


The  third  subassembly  diagram  illustrates 
another  type  of  reliability  problem  in  that  the  subassembly 
reliability  is  defined  in  Ref.  3  as  follows: 

I       R 
R    =  i=45   i 
SS 
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Although  these  diagrams  represent  current 
systems,  the  reliability  values  chosen  bear  no  intentional 
relation  to  actual  values  other  than  that  acquired  when 
choosing  them  on  a  criteria  of  reasonableness.  Therefore 
the  values  used  are  not  classified. 
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IV.   RESULTS  AND  CONCLUSIONS 


A.   SIMULATION  RESULTS 


The  simulation  output  is  listed  in  detail  in  Appendix  0 
for  each  run.  Each  case  was  simulated  three  times  with 
different  random  number  generator  seed  values  to  insure 
against  the  occurrance  of  non-representative  siugularities 
in  the  observed  data.  Each  simulation  is  distinguished  by  a 
letter  suffix,  a,  b#  or  c,  to  the  case  number  in  Appendix  D. 
The  starting  seed  used  each  time  was  the  ending  seed  value 
from  the  previous  run.  This  insured  that  each  run  would  be 
independent  [Ref.  5]. 

The  demonstrated  accuracy  of  the  estimation  procedure 
can  be  measured  in  terms  of  the  difference  between  the 
100  (1-a)  percentile  of  the  simulation  results,  R*°,  and  the 
true  system  reliability,  Rs.  This  difference,  labeled  D  in 
the  output  tables,  is  defined  as  follows: 

D  =  R*o  -  Rs  (4.1) 

As  mentioned  in  Section  III. A,  the  absolute  value  of  D 
should  be  small  and  reflect  a  conservative  error.  This 
desired  conservati vism  is  satisfied  so  long  as  the  sign  of  D 
is  negative.  Otherwise  the  lower  confidence  limit 
estimation  procedure  would  yield  overly-optomistic  estimates 
and  could  not  be  a  valid  vehicle  for  the  description  of 
system  reliability.  The  one  instance  where  this  condition 
was  not  satisfied  occurred  in  Case  13c.  However,  the  value 
of   D  was  extremely  small,  represented  less  than  one-half  of 
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one   percent   error,   and   differed   from   the   conservative 
results  of  the  other  runs  by  less  than  one  percent. 

It  should  also  be  noted  that  the  distributions  of  the 
estimates  Ti,  S,  and  r  are  discrete  in  nature  and  the  values 
are  determined  by  the  number  and  arrangement  of  components 
and  the  number  of  component  tests.  Estimates  based  upon  few 
failures  will  exhibit  the  most  highly  discrate  sample 
distribution  scheme.  The  effect  of  this  discreteness  will 
generally  be  to  increase  the  observed  error  magnitude  unless 
some  form  of  continuity  correction  can  be  developed. 


B.   ANALYSIS  OF  RESULTS 


1 .   General  Characteristics 

The  simulation  output  for  Cases  One  through  Twelve 
was  expanded  to  include  the  complete  ordered  arrays  of 
estimated  confidence  limit  values  in  order  to  establish  the 
nature  of  the  sample.  Some  properties  were  evident  from 
inspection.  The  samples  were  unimodal  and  discrete,  as 
expected.  Discreteness  was  most  pronounced  in  the  higher 
valued  estimates.  The  sample  distribution  appeared  nearly 
symmetric  and  this  supposition  was  checked  by  comparing  the 
sample  mean  and  median  values  and  also  by  plotting 
complementary  guantiles.  The  first  test  showed  very  close 
agreement  throughout.  The  second  test  indicated  that  only 
minor  left  skewness  exists  in  most  cases.  Skewness  seemed 
more  pronounced  for  higher  values  of  system  reliability,  as 
might  be  expected  might  be  suspected,  since  the  distribution 
is  bounded  by  an  upper  estimate  value  of  1.0. 

The  shape  of  the  distribution  was  further   described 


28 


by  examining  the  ratio  of  the  interquartile  range  divided  by 
the  interdecile  range  and  comparing  it  with  the  same  ratio 
from  the  Normal  distribution  which  is  about  0.526.  The 
observed  values  were  generally  on  the  order  of  0.50  which  is 
in  good  agreement  considering  the  discrete  nature  of  the 
sample  distribution.  Systems  designed  with  high  reliability 
coupled  with  insufficient  testing,  such  as  Cases  18  and  19, 
exhibited  great  variations  in  the  ratio,  from  0.2  to  1.0, 
due  to  the  sparcity  of  different  sample  values  occuring  in 
the  pronouncedly  discrete  sample  distribution. 

Another  useful  measure  of  shape  is  the  sample 
standard  deviation.  It  is  particularly  halpful  in 
quantifying  the  spread  of  the  data  in  terms  of  the  units  of 
measure.  The  preceeding  ratio,  on  the  other  hand,  was 
independent  of  the  units.  The  sample  standard  deviation, 
however,  gives  no  indication  of  skewness  nor  the 
discreteness  of  the  underlying  distribution.  The  standard 
deviation  i-s  most  useful  when  these  higher  order  effects  are 
small. 

The  ability  to  predict  the  standard  deviation  from 
the  test  plan  an£  system  design  parameters  would  provide  an 
additional  measure  of  the  system  reliability.  This  concept 
evolves  from  a  consideration  of  the  100 (1-a)  percent  lower 
confidence  limit.  Of  itself,  it  tells  us  only  that  there  is 
a  (1-a)  probability  that  the  true  system  reliability  is 
greater  than  a  particular  value.  The  standard  deviation  of 
the  estimate  of  this  confidence  limit  can  provide  a  feel  for 
how  much  the  true  system  reliability  might  vary  from  the 
estimate.  For  example,  given  an  eighty  percent  lower 
confidence  limit  of  0.78  and  a  predicted  standard  deviation 
of  the  estimate  of  0.005,  we  can  feel  fairly  certain  that 
the  true  system  reliability  does  not  exceed  0.82.  However, 
had  the  standard  deviation  been  0.01  or  0.02,  there  would  be 
increasing  uncertainty  about  the  range  of  likely   values   of 
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true  reliability.  Therefore,  the  sample  standard  deviation 
has  been  included  in  the  regression  section  later  in  this 
chapter  in  an  effort  to  not  only  predict  procedure  accuracy, 
but  also  estimate  spread. 

2.   Derivation  and  Discussion  of  TT 


Previous  tests  of  the  original  Log-Gamma  procedure 
have  indicated  that  the  quantity 

k 
TT  =  I     (Ni)  (Qi)  (4.2) 

i=1 

could  be  used  as  an  indicator  of  relative  accuracy  of  the 
procedure,  where  Ni  is  the  number  of  mission  tests  performed 
upon  the  i-th  component  and  Qi  is  the  design  or  expected 
unreliability  goal  for  the  i-th  component  [Ref.  1].  The 
quantity  determined  in  this  manner  was  the  total  amount  of 
testing  relative  to  the  component  unreliabilities,  or, 
approximately,  the  expected  number  of  test  failures  summed 
over  all  components  and  tests. 

A  similiar  measure  was  sought  for  the  revised 
procedure  examined  in  this  paper.  However,  a  simple 
expression,  such  as  equation  (4.2),  could  not  be  directly 
applied  to  the  mixed  series-parallel  system.  If  the 
equation  were  used,  it  could  lead  to  extremely  large  values 
of  TT,  since  the  parallel  components  would  tend  to  dominate 
the  sum.  This  is  reasonable  to  expect,  since  the  components 
connected  in  parallel,  taken  individually,  would  tend  to 
have  greater  unreliability  than  the  series  components. 

The  first  revised  equation  proposed  for  TT  can  be 
used  whenever  all  components  within  each  parallel  subsystem 
are  given  identical  numbers  of  mission  tests. 
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K 1  K  1  +  K  2 

TT  =   E  (Ni)  (Qi)  +    Z  (Ni«)  (Qi»)  (4.3) 

i=1  i=K1+1 

where  K1  is  the  number  of  series  components  in  the  system 

K2  is  the  number  of  series-parallel  subassemblies 
connected  in  logical  series  in  the  system 

Ni,  Qi  are  defined  as  above. 

Ni'  is  the  common  number  of  tests  given  each  component 
in  the  i-th  subassembly. 

Qi1  is  the  unreliability  of  the  i-th  subassembly 
computed  from  its  component  unreliability  goals  using 
standard  series-parallel  reliability  computation  techniques. 

Equation  (4.3),  in  effect,  reduces  each  subassembly 
to  an  equivalent  'pseudo-component1  connected  in  series  in 
the  system.  The  quantity  TT  is  now  approximately  equal  to 
the  expected  number  of  system-affecting  failures  summed  over 
all  components,  subassemblies,  and  tests.  However,  the 
drawback  of  this  equation  is  the  necessity  of  testing  all 
components  within  a  subassembly  an  identical  number  of 
times.  It  would  seem  unnecessarily  restrictive  to  conduct 
the  same  number  of  tests  on  a  medium  reliability  component 
and  on  a  high  reliability  component  just  to  satisfy  the 
equation. 

Therefore  an  alternate  formulation  for  the  term 
(Ni1)  (Qi')  was  sought  which  would  provide  a  meaningful 
measure,  and  yet  would  allow  unequal  amounts  of  testing 
within  subassemblies.  The  following  ad  hoc  formulation  is 
proposed : 

Each  wholly  series-connected  branch  within  a 
subsystem  will  first  be  reduced  to  an  equivalent  single 
component  by  the  following  formula 

£  (Ni)  (1-Ri) 

i£B 
Nb  = (4.4) 

1  -  Rb 
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where  Rb  is  the  classically   determined   branch   reliability 

goal  Rb  =   n  Ri  for  series-connected  components. 
ieB 

Ri  is  the  reliability  goal  of  the  i-th  component. 

B  is  the  set  of  all  components  in  the  branch. 

Nb  represents  an  "equivalent"  number  of   branch   tests 

(need  not  be  integer)  . 

The  series-connected  branch  is  replaced  in  the 
remaining  computations  by  a  single  equivalent  component  with 
reliability  goal  Ri  =  Rb  and  number  of  mission  tests  Ni  = 
Nb. 

After  all  wholly  series-connected  branches  have  been 
reduced  in  this  manner,  each  wholly  parallel-connected 
branch  in  the  revised  subassembly  is  reduced  to  an 
equivalent  component  in  the  following  manner: 

Compute  the  equivalent  reliability  goal 

Rb  =  1  -  n  (1-Ri) 

i^B 

in  the  usual  manner. 

The   number   of   possible  combinations  of  individual 

test  results  for  the  branch  components  is   n   Ni,   which   is 

i£B 

set   equal   to  the.  same   number   of   possible  combinations 

obtained  if  each  component  had  been  tested  Nb  times.  Thus 
the  equivalent  number  of  mission  tests,  Nb,  is  computed  as 
the  geometric  mean  of  the  component  tests 


r  „   . l1/m 
Nb  =    n  Ni I 

Lie  B   J 


The  above  procedure  is   repeated   until   the   entire 
subassembly  is  reduced  to  a  single  equivalent  component,  i', 
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with  its  equivalent  number  of  mission  trials,  Ni1,  and 
equivalent  unreliability  goal,  Qi»  =  1-Ri».  TT  may  then  be 
computed  as  before: 

K1  K1+K2 

TT  =  Z     (Ni)  (Qi)  ♦    Z  (Ni»)  (Qi«)  (4.3) 

i=1  i=K1+1 


3.  Accuracy  Prediction 

Appendix  E  contains  the  equations  and  methodology 
used  to  attempt  to  relate  the  accuracy  measure,  D,  and  the 
estimate  standard  deviation  to  the  quantity  TT.  The 
principal  conclusion  to  be  drawn  from  the  results  is  that 
accuracy  is  a  predictable  quantity  only  with  respect  to 
particular  system  configurations  for  which  models  have  been 
generated  and  tested  as  in  this  paper.  Accuracy  seems  an 
unstable  variable  from  configuration  to  configuration, 
although  it  appears  to  be  fairly  well  behaved  within  any  one 
configuration. 

V 

With  respect  to  the  estimate  standard  deviation,  the 
value  appears  to  be  related  more  to  the  number  of  component 
tests  than  to  the  expected  number  of  system  affecting 
failures.  Reduction  in  the  magnitude  of  tha  standard 
deviation  by  about  0.01  appears  to  require  alomst  double  the 
number  of  component  tests.  However,  the  magnitudes  are 
generally  less  than  0.07  for  component  test  sample  sizes  of 
20  or  more.  The  standard  deviation  values  also  appear  to  be 
fairly  insensitive  to  changes  in  system  configuration. 

4 .  Comparison  w it h  Ea r 1 ier  Results. 

Cases  13  through  20  were  taken  from  Ref.  1  in  order 
to  provide  a   basis   for   checking   relative   accuracy   when 
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extending  the  Log-gamma  procedure  beyond  simple  series 
systems.  Unfortunately,  an  apparent  shortcoming  of  the 
original  simulation  makes  the  1968  data  suspect. 

The  original  results  tended  to  be  too  optimistic  for 
those  cases,  in  particular,  where  the  number  of  component 
tests  was  moderately  low  and  the  true  component 
reliabilities  were  high.  Significantly  high  estimates  at 
the  100  (1-a)  percentile  were  observed  in  the  cases 
corresponding  to  Cases  13,  15,  18,  19,  and  20  of  the  present 
study.  Although,  on  this  basis,  the  comparison  is  very 
favorable  to  the  present  procedure,  it  is  thought  that  the 
original  simulation  results  are  in  error  with  respect  to  the 
procedure.  Reference  1  does  not  specifically  identify  the 
random  number  generator  used,  however  some  uniform  random 
variate  generators  do  not  perform  well  for  very  small  or 
very  large  numbers  near  the  boundaries,  such  as  would  be 
encountered  in  the  simulation  procedure  used  in  the  original 
study.  The  present  simulation  binomial  random  variate 
generator  was  tested  prior  to  use  to  insure  proper 
performance  throughout  the  range  of  simulation  values   used. 

Of  the  remaining  cases  (14,  16,  and  17)  the  original 
results  were  much  closer  to  the  true  system  reliability  in 
the  first  two  cases  and  comparable  in  the  last  case. 
However,  these  results  cannot  be  considered  meaningful  in 
light  of  the  suspected  problems  with  the  random  number 
generator. 

In  addition,  many  instances  of  cases  found  in  Ref.  1 
had   prima-facia   unreasonable   results   for   the    100  (1-a) 
percentile   values,   in   that   they  were  considerably  higher 
than  the  upper  bound  imposed  by  the   zero-failure,   binomial 
system  test  treatment  discussed  in  Appendix  C. 

Another  difference  between  the   original   study   and 
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the  present  one  is  the  use  of  an  arbitrary  continuity 
correction  in  the  earlier  procedure.  This  could  also  have 
been  a  contributor  to  the  excess  optimism  in  the  reported 
simulation  results. 

In   light  of  the  foregoing  paragraphs,  no  comparison 
with  the  results  of  this  study  was  deemed  worthwhile. 


C.   CONCLUSIONS 


The  primary  conclusion  to  be  drawn  from  this  study  is 
that  the  Log-gamma  lower  confidence  level  procedure  for 
series-parallel  systems  can  be  accurate.  How  accurate  it 
will  be  in  any  specific  application  is  a  function  of  the 
magnitude  of  the  component  tes'cing  program,  the  individual 
component  reliabilities,  and  the  complexity  of  the  system. 
In  addition,  of  course,  the  validity  of  the  assumptions 
concerning  component  interaction  and  mission  environment 
will  also  tear  directly  upon  the  accuracy  of  any  procedure 
which  purports  to  estimate  system  mission  reliability  from 
component  test  results.  The  effects  of  these  assumptions, 
however  will  be  controlled  by  the  proper  design  of  the 
component  test  procedures  and  are  not  addressed  in  this 
study. 

For  the  cases  considered  the  Log-gamma  procedure  tends 
to  be  conservative,  which  is  necessary  if  one  takes  the 
position  that  pleasant  surprises  with  better  than  expected 
performance  cost  less  than  unpleasant  surprises  in  the  form 
of  degraded  demonstrated  reliability.  Of  coursa ,  too  much 
underestimation  of  system  reliability  could  drive  up  the 
development  costs  in  an  unnecessary  search  for  a  much  more 
reliable  design. 
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The  accuracy  indicator  TT  developed  in  Section  IV. B. 2 
can  be  used  as  a  rough  gauge  of  expected  procedure  accuracy. 
The  following  scheme  is  suggested  for  minimum  values  of  TT 
for  fairly  good  expected  accuracy: 

Approximate 

Order  of  a  =  0.20     a  =  0.10     a  =  0.05 

Accuracy 

0.02  6.1         12.8         19.2 

0.01  11.7         23.6         32.6 

However,  since  procedure  accuracy'  is  so  demonstrably 
sensitive  to  variation  in  the  system  configuration,  the  best 
approach  prior  to  use  of  the  Log-gamma  procedure  is  to 
perform  a  simulation  as  described  in  Section  III. A  for  the 
particular  system  design  to  be  exercised.  Such  a  simulation 
could  be  used  to  evaluate  many  different  combinations  of 
component  test  plans  and  also  support  the  claimed  accuracy 
of  the  lower  confidence  limit  derived  from  the  adopted  test 
plan  results.  The  investment  in  such  a  simulation  effort 
should  not  be  excessive  from  the  standpoint  of  computer 
time,  since  the  most  complex  cases  examined  in  this  study 
required  less  than  five  minutes  of  Central  Processor  Unit 
(CPU)  time  from  start  to  end.  Without  the  support  of  such  a 
simulation  specific  to  the  system,  the  accuracy  of  the 
procedure  can  be  predicted  only  very  approximately. 

For  extremely  reliable  systems,  for  which  few  failures 
are  expected  with  large  amounts  of  testing,  ths  binomial 
lower  confidence  limit  procedure  developed  in  Appendix  C 
might  provide  the  desired  magnitude  of  the  lower  confidence 
limit  without  the  extra  testing  required  to  achieve  the 
desired  accuracy  of  the  Log-gamma  procedure.  In  fact,  for 
cases  of  one  failure  or  less,  the  binomial  procedure  is 
probably  preferable  on  the  basis  of  both  theoretical  rigor 
and  ease  of  computation. 
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Finally,  the  matter  of  a  continuity  correction  should  be 
investigated.  An  appropriately  determined  continuity 
correction  procedure  could  conceivably  reduce  the  component 
testing  reguirements  for  the  same  expected  procedure 
accuracy . 
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APPENDIX  A 


DERIVATION  OF  aNBIASED  ESTIMATE  FOR  Ti 


For 

Ti  =  Qi  +  Qi2/2 

an  unbiased  estimator  is  desired,  based  upon  the  component 
failure  data.  Let  Fi  be  the  number  of  failures  observed  in 
Ni  mission  tests  on  the  i-th  component.  The  expected  value 
of  Fi  is  NiQi  and  an  unbiased  estimator,  Qi,  for  Qi  is 
Fi/Ni,  where  Fi  is  binomially  distributed  with  parameters  Qi 
and  Ni;  Qi  =  1-Ri;  and  Ri  is  the  true  reliability  of  the 
i-th  component. 

An  estimator,  Ti,  for  Ti  will  be  chosen  of  the  form 

Ti  =  Ai[Qi]  +  Bi[Qi2]/2  (A.1) 

and  the  constants  Ai  and  Bi  chosen  so  as  to  make  the 
estimator  unbiased,  that  is  the  expected  value  of  Ti  is 
equal  to  Ti, 

E[Ti]  =  Ti  =  Qi  ♦  Qi2/2  (A.  2) 

=  AiE[Qi]  ♦  (Bi/2)E[Qi2] 

=  (Ai/Ni)E[Fi]  +  (B/2Ni2)  E[Fi2] 

=  (Ai/Ni)  [NiQi] 

♦    (Bi/2Ni2) [NiQi-NiQi2+Ni2Qi2 ] 

=    AiQi    ♦    BiQi/2Ni    -    BiQi2/2Ni    +    BiQi2/2 

=    [ Ai    +    Bi/2Ni]Qi    +    [ Bi/2    -    Bi/2Ni]Qi2     (A. 3) 
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Equating  equation  (A. 3)  term  by   term   with   equation   (A. 2) 
yields  the  following  two  equations 

Ai  +  Bi/2Ni  =  1 

and       Bi  -  Bi/Ni  =  1 

which  reduce   to   expressions   for   the   unbiased   estimator 
constants: 

Ai  =  (2Ni-3)/(2Ni-2)  (A. 4) 

and       Bi  =  Ni/(Ni-1)  (A. 5) 
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APPENDIX  B 


APPROXIMATION  0?  Var[ Ti  ]  BY  Ti/Ni 


A.   DERIVATION  OF  Var[Ti] 

The  variance  of  Ti  is  derived  as  follows: 

From  appendix  A, 

Ti  =  AiQi  +  (BiQi2)/2  (B.1) 

thus,      Ti2  =  Ai2Qi2  +  AiBiQi3  +  (Bi2Qi*)/4  (B.2) 

Var[Ti]    =    ErTi2]    -    E2[Ti]  (B.3) 

=    Effi2]    -    Ti2 

=    (Ai2/Ni2) E[Fi2 ]   +     (AiBi/Ni3) E[  Fi3  ] 
+    (Bi2/4Ni*) E[Fi*  ] 

-    [Qi2  +  Qi3+(Qi*/4)  ]  (B.4) 

Using      the      moment      generating      functions    for  the    binomially 
distributed    variable   Fi,    with    parameters   Qi    and   Ni,    yields 

E[Fi]  =    NiQi  (3.5) 

E[Fi2]   =    NiQi    +    NiQi2(Ni-1)  (B.6) 

E[Fi3]   =    NiQi    +    NiQi2  (Ni-1)  [  3  +  Qi  (Ni-2)  ]  (B.7) 

E[Fi*]    =    NiQi*  (Ni-1)   (Ni-2)  (Ni-3)     +    7NiQi2  (Ni-1) 

+    6NiQi3(Ni-1)  (Ni-2)     +    NiQi  (B.3) 
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Substituting   the  jnoment   equations       (B.5)       through       (B.8) 
into   equation    (B.4)    and    simplifying   the   resulting    expression 
yields   the   following    equation    for    the    variance   of   Ti: 

4Ni2-3Ni+1  3Ni-4 

Var[Ti]    =  Qi    +   Qi* 

4Ni(Ni-1)2  2Ni(Ni-1) 

1  2Ni-3 

Qi3 Qi*  (B.9) 

Ni-1  2Ni(Ni-1) 

or,  in  terms  of  Ai,  Bir  Ni,  and  Qi: 

Bi2+2Ni2Bi(Ai+Bi)       2Ai+1 

VarfTi]  =  Qi  +  Qi2 

4Ni3  2Ni 

Bi       Ai 
-  —  Qi3  -  —  Qi*  (B. 10) 

Ni       Ni 


To  test  the  approximation  of  Var[Ti]  by  Ti/Ni,  equation 
(B.9)  was  solved  with  representative  valures  of  Qi  and  Ni 
and  compared  with  E[fi]/Ni.  The  percent  error  of  the 
approximation  was  computed  for  each  value  and  is  given  in 
table  B-1.  As  expected,  increasing  Ni  or  decreasing  Qi 
improves  the  accuracy  of  the  approximation. 

By  way  of  comparison,  table  B-2  shows  the  relative 
accuracy  of  this  same  approximation  when  Ti  is  defined  as 
the  first  three,  vice  two,  terms  of  the  logarithmic  series 
expansion  of  S  [Eq.  (2.3)  ].  In  this  case  the  unbiased 
estimator  for  Ti  will  be 

Ti  =  Ai'Qi  +  Bi«Qi2/2  +  Ci«Qi3/3  (B.11) 

where           6 (Ni-  1)  (Ni-2) -3  (Ni-4) -2 
Ai'  =  


Bi'  = 


Ci«  = 


6 (Ni-1)  (Ni-2) 

Ni(Ni-U) 


(Ni-1)  (Ni-2) 

Ni2 
(Ni-1)  (Ni-2) 
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Qi 

Ni  =  10 

Ni  =  50 

Ni  =  100 

0.001 

-5.08% 

-1.10% 

-0.60% 

0.003 

-5.25% 

-1.29% 

-0.79% 

0.006 

-5.52% 

-1.58% 

-1.09% 

0.01 

-5.87% 

-1.96% 

-1.47% 

0.03 

-7.50% 

-3.73% 

-3.26% 

0.06 

-9.64% 

-6.07% 

-5.62% 

0.10 

-12.0% 

-8.65% 

-8.23% 

0.20 

-15.8% 

-12.9% 

-12.5% 

0.30 

-17.0% 

-14.4% 

-14.1% 

0.40 

-15.8% 

-13.4% 

-13.1% 

0.50 

-12.0% 

-9.67% 

-9.38% 

0.60 

-4.77% 

-2.40% 

-2.11% 

0.70 

+7.70% 

+10.3% 

+10.6% 

Table  B-1 .   grror  Percentage  of  approximation 
for  Var[Ti]  asing  Two-term  Form  of  Ti. 


Qi 

Ni  =  10 

Ni  =  50 

Ni  =  100 

0.001 

-0.06% 

-0.05% 

-0.05% 

0.003 

-0.17% 

-0.15% 

-0.15% 

0.006 

-0.33% 

-0.31% 

-0.30% 

0.01 

-0.56% 

-0.51% 

-0.51% 

0.03 

-1.68% 

-1.54% 

-1.53% 

0.06 

-3.36% 

-3.09% 

-3.06% 

0.10 

-5.57% 

-5. 11% 

-5.06% 

Table  B-2.  ..Error  Percentage  of  approximation 
for  Var[Ti]  (Jsing  Three-term  Form  of  Ti. 


Due  to  time  constraints  and  the  general  acceptability  of 
the  values  noted  in  table  B-1,  the  use  of  the  more  complex 
definition  of  Ti  was  left  for  future  study.  However,  figure 
B-1  plots  the  accuracy  as  a  function  of  Qir  Ni,  and  form  of 
Ti. 
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Ni  =  10 


-18% 


Figure  B-1.  PERCENTAGE  ERROR  OF  APPROXIMATION  FOR  VAR[Ti] 
VS.  COMPONENT  UNRELIABILITY. 
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APPENDIX  C 


SPECIAL  CONSIDERATIONS  WHEN  S  EQUALS  ZERO 


When  all  components  have  completed  the  course  of  mission 
tests  and  no  failures  have  been  observed  along  some 
reliability  path  through  the  system,  the  estimator  S  will 
equal  zero.  This,  in  turn,  will  result  in  the  log-gamma 
lower  confidence  limit  estimate  being  equal  to  one  unless 
the  procedure  is  modified  to  include  some  "virtual"  or 
"pseudo"  test  failure  value  for  the  computations  when  this 
occurs.  The  alternative  is  to  seek  some  other  lower 
confidence  limit  procedure  which  applies  with  zero  failures. 
Such  an  alternative  is  also  suggested  below. 

For  simplicity,  assume  all  series  components  and 
subassemblies  have  been  subjected  to  an  equal  number  of 
mission  trials,  N,  without  failure.  This  may  be  thought  of 
as  equivalent  to  conducting  N  mission  trials  on  the  system 
without  failure,  subject  to  the  usual  assumptions  concerning 
test  environment  and  component  interaction  effects.  When 
unequal  numbers  of  component  trials  are  involved,  the 
conservative  course  of  action  is  to  choose  N  equal  to  the 
smallest  of  the  component  trial  values. 

Now  the  number  of  system  mission  trial  successes,  W,  can 
be  related  to  system  mission  reliability,  Rs,  by  the 
binomial  distribution  formula 


N   /  N  \ 


j         N- j 
(Rs)  (1  -  Rs)     =  Prob(#  successes  >  W)  (C.1) 
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where  N  =  number  of  mission  trials 

The  100(1-a)ft  Lower  Confidence  Limit  Estimate  for  system 
reliability  would  then  be  the  solution  for  R*  in  the 
following  formula: 


N 


j  =  W  >       ' 


j         N-j 
(R*)   (1  -  R*)      =  a 


(C.2) 


which,  when  W  =  N,  reduces  to 


(R*) 


=  a 


or   R*  =  (  a  ) 


1/N 


This  result  may  then  be  substituted  into  the  Log-gamma 
procedure  formula  for  R*< a)  and  solved  for  the  number  of 
equivalent  component  failures  which  would  yield  the  same 
estimate  of  system  reliability. 


R*ca)  =  exp 


L  AC2r],1-a  J 


=  (  a  ) 


1/N 


where 


K 
S  =   Z  Ti 
i=1 


r  =  max 


1.0, 


K 

Z   Ti 
i=1 


K   Ti 

Z   — 

i=1  Ni 


(C.3) 


which  reduce  to  S  =  Ti  and  r  =  max[1,(Ni)  (Ti)  ],  since  only 
one  component  or  subassembly  will  make  a  non-zero 
contribution  to  the  sums. 

Now,  if  r  =  1.0,  then  (Ni) (fi)  <  1.0    and   Ti   <   1/Ni. 
Also  recall  that 


Ti  =  (Ai)  (Qi)  +  (Bi/2)  (Qi*) 


where 


2Ni  -  3  Ni 

Ai  =  : — —  ,    Bi  = 


2  (Ni-1) 


Fl 

Qi  =  -r 
Ni-1  Ni 


(2.5) 
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Or,  equivalently, 

(Bi/2Ni2)  (Fi2)  *  (Ai/Ni)  (Fi)  -  Ti  =  0        (C.4) 
Substituting  for  Ai,  Bi  and  the  earlier  inequality  for  Ti, 


Ni 


L2  (Ni-1)  (Ni*) 
which  reduces  to 


(Fi2)  ♦ 


2Ni-3  1 

: —  (Fi)  -  --  <  0 

2  (Ni-1)  (Ni)  J        Ni 


Fi2  ♦  (2Ni-3)Fi  -  2  (Ni-1)  <  0 
which,  in  turn,  can  be  factored  as 

(Fi  -  1)  [Fi  +  2  (Ni-1)  ]  <  0 


(C.5) 


The  only  positive  values  for  Fi  which  can  satisfy  this  last 
equation  are  Fi  less  than  or  equal  to  one.  This  means  that 
for  any  size  Ni,  the  value  of  [2r]  will  be  two.  We  can  now 
solve  the  reliability  estimate  equation  for  Fi*,  the  number 
of  equivalent  failures  for  the  Log-gamma  method. 


S    = 


-[2r]   S 
L     /C[2r],1-a   J 

f  X.2,  1-a] 

l-Sr- J(ln  a)  = 


=  (  a  ) 


1/N 


(C.6) 


Ai(Fi*)    Bi(Fi*)  2 
+ 


N 


2N2 


(C.7) 


which  reduces  to 

Fi*2  +  (2N-3)Fi*  +  (N-1)(lna) 


2, 1-a   =  0  (C.8) 


This  quadratic  may  be  solved  for  Fi*  as  a  function  of  N 
and  a.  The  results  are  listed  in  table  C-1.  From  the 
table,  choosing  Fi*  at  the  N  =  10  level  will  be  conservative 
for  all  N  greater  than  10,  yet  will  yield  relatively 
accurate  results  for  all  larger  N  due  to  the  slow  rate  of 
change  of  Fi*  with  respect  to  N. 
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N 

a=0.2 

a  =  0.1 

a  =  .05 

5 

0.3888 

0.2670 

0. 1713 

10 

0.3721 

0.2531 

0.1610 

20 

0.3652 

0.2475 

0.1570 

100 

0.3603 

0.2435 

0.1542 

1000 

0.3593 

0.2427 

0.1536 

Table  C- 1 .   Solution  for  Fi*  with 
Various  N  and  a  Values. 
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APPENDIX  D 


TABULATED  SIMULATION  RESULTS 


The  following  pages  contain  two  tables  listing  the 
principal  simulation  output  data.  The  tables  are  presented 
concurrently  for  each  case,  one  case  per  page.  The  cases 
are  listed  in  alpha-numecic  order.  The  following  list  of 
terms  applies: 

Case:  The  case  number  as  explained  in  Section  III.B.  The 
letter  suffix  distinguishes  between  different  runs  of 
the  same  case  using  different  seeds  for  the  binomial 
random  variate  generating  function. 

KK:    The  total  number  of  components  in  the  system. 

TT:    The  accuracy  indicator  as  discussed  in  seciton  IV. B. 

TM:  The  modified  accuracy  indicator  described  in  Appendix 
E. 

Hs:    True  system  reliability. 

CL:    Confidence  Level,  ZL   =  100  (1-a)  . 

R*°:  The  100  (1-a)  percentile  of  the  simulation  estimates  of 
the  100  (1-a) %  lower  confidence  limit  for  system 
reliability . 

D:  The  primary  accuracy  measure.  As  discussed  in  Section 
IV. A,  D  =  «*°  -  Rs. 

Mean:  The  sample  mean  of  the  estimates. 

S.D.:  The  sample  standard  deviation  of  the  estimates. 
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Null  Runs:  The  number  of  runs  which  occured  during  the 
simulation  for  which  S  equalled  zero.  Refer  to 
sections  II. C  and  III. A  and  Appendix  C  for  further 
elaboration. 
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APPENDIX  E 


REGRESSION  OF  OBSERVED  ACCURACY 


Examination  of  the  tabulated  data  in  Appendix  D  suggests 
that  a  linear  relationship  is  not  directly  applicable  to 
regression  of  the  accuracy  measure,  d,  on  any  of  the  other 
variables.  The  terms  TT,  developed  in  section  IV. B. 2,  and 
KK,  the  number  of  components,  appear  to  be  the  most  likely 
candidate  independent  variables  for  the  model.  Plots  of 
these  terms  versus  D  suggest  that  an  exponential  decreasing 
or  inverse  power  curve  could  be  used  to  model  procedure 
accuracy  on  TT,  i.e. 

D  =  a«exp(b»TT)  (E.1) 

b 
D  =  a«TT  (E.2) 

where  a  and  b  are  appropriate  constants  from  the  underlying 
response  function.  Each  of  these  models  can  be  easily 
transformed  into  a  linear  model  by  taking  the  natural 
logarithm  and  redefining  variables  and  coefficients  where 
convenient. 

The  plots  indicate,  however,  that  the  system 
configuration  has  a  strong  effect.  Therefore,  curve  fitting 
will  be  initially  confined  to  similar  configurations  in  the 
following  groups:  Cases  01  to  12,  Cases  14  to  17,  and  Cases 
22  to  29.  Cases  1 8  to  21  will  be  considered  only  with 
reservations  due  to  the  artificial  bias  introduced  by  the 
particular  procedure  used  which   ignored   failureless   runs. 
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Cases  30  to  33  will  not  be  fitted  since  the  procedure 
employed  caused  the  sample  to  be  drawn  from  two  quite  unlike 
distributions  and  ths  plots  demonstrated  an  apparent 
discontinuity  between  the  results  of  the  two  methods  (see 
Section  II. C  and  Appendix  C) .  Finally,  if  the  group  fits 
are  good,  a  composite  fit  will  be  attempted  for  Cases  01  to 
17  and  22  to  29.  This  fit  would  not  be  expected  to  be  good 
due  to  the  observed  inter-group  plot  variation. 


A.   EXPONENTIAL  CURVE  FIT 


Consider  the  linearized  exponential  model 
D»  =  A  +  b«TT 


(E.3) 


where      D'    =    In (-D)     and   A   =    In  (-a) .      From   the   Method   of   Least 
Squares,    expressions   for   A    and  b    can   be   derived   directly. 


1  r   n 


b   = 


n  '  r  n         irni 

E   TT   D« E    TT  Z    D 

i=1      i    i        nk  =  1      iJ  <-i  =  1    i' 


n  i  r  n  ! 

Z    TT2    -    -I     £    TT 
i=1      i        nU  =  1      i-l 


1r  n        -i         br   n  t 

A    =  -j     Z    D» |    -    -j     £    TT    | 

n»-i=1    iJ         n«-i=i      iJ 


and   the   coefficient   of   determination   [Ref.    6  ]  is 


rz   =  - 


Z    XT    D»    T   E    D1] T    E    IT  ]| 

i=1      i    i        n>-i=1    iJ  Li=i      i  J  J 


n  1r  n  T2lfn  1r  n        -,  21 

E    TT2 1     E    TT  ED'2 I    DM 

i=1      i        n^i  =  i      iJ       [i=l    i  n»-i=1    iJ     J 


The      results      of      the      exponential      curve      fit      were      as 
follows: 
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Cases    _a_  a b r2 

01-12    .20  -0.040  -0.065  0.690 

.10  -0.094  -0.076  0.724 

.05  -0.073  -0.048  0.738 

14-17    .20  -0.118  -0.290  0.942 

.10  -0.301  -0.282  0.938 

.05  -0.480  -0.260  0.988 

22-29    .20  -0.049  -0.156  0.896 

.10  -0.153  -0.170  0.899 

.05  -0.346  -0.216  0.917 


B.   INVEHSE  POWER  CURVE  FIT 

The  power  curve  may  be  linearized  to  the  form 

D»  =  A  +  b«TT'  (E.3) 

where  A  and  D1  are  defined  as  before  and  TT*  =  In (TT) .  The 
coefficients/  A  and  b,  and  the  coefficient  of  determination 
may  be  found  as  described  in  the  preceding  section  with  the 
substitution  of  TT ■  for  TT  where  occuring. 

The  results  of  the  power  curve  fit  were  as  follows: 
Cases    a         a        b       r2 


01-12 

.20 
.10 
.05 

-0. 130 
-0.368 
-0.780 

-0.868 
-1.016 
-1.  124 

0.844 
0.883 
0.893 

14-17 

.20 
.10 
.05 

-0.664 
-1.589 
-2.110 

-2.085 
-2.016 
-1.828 

0.986 
0.972 
0.992 

22-29 

.20 
.10 
.05 

-0.159 
-0.543 
-1.041 

-1.305 
-1.412 
-1.430 

0.989 
0.977 
0.980 

01-17 
22-29 

.20 
.10 
.05 

-0.  136 
-0.459 
-0.936 

-1 .06  0 
-1.228 
-1.303 

0.648 
0.793 
0.845 

Comparing  these  results  with  those  of  the  exponential 
curve  fit  indicates  that  the  power  curve  provides  a  better 
fit  for  the  observed  simulation  data.  However,  the 
variation   in   the   coefficients   between   different   system 
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configurations  implies  that,  while  the  fit  may  be  good 
within  like  groups,  the  fit  is  much  more  approximate  across 
the  groups.  This  is  borne  out  by  the  composite  fit  listed 
last  in  the  preceding  table. 


C.   REGRESSION  OF  D  ON  TT  AND  KK 


For   this   regression   the   model   chosen  was  a  combined 
power  curve 

b  c 
D  =  a«TT  KK  (E.5) 

which  linearizes  to 

D«  =  A  +  b«TT»  +  c«KK»  (E.6) 

where  D1,  A,  and  TT1  are  defined  as  before  and  KK'  =  ln(KK). 

Solving   for   the   coefficient   values   by  the  Method  of 
Least  Squares  yields  the  following: 

rS1«S2              irS1»S3              t          rS2»S3              -,  rS  1  2  t 

| S6    I S8|    -    j -    S7    | S4| 


c   = 


PS12               irS32               t           rS1«S3  ,2 

[ S4)| -    S5|    -     j S8| 

l   n  j  l   n  j  l      n  j 


rSl»S2  t  rS1«S3  t 

S6I     -    c\ S8| 

t     n  J  «-      n  j 

b   = 

S12 

—  -  su 

n 


i-1  b  c      n 

a    =   exp|-S2  -  -S1    -   -S3 

«-n  n  n      -* 

where  n  n  n 

S1    =       Z    TT«  S2    =      ED'  S3    =      Z    KK  ■ 

i=1i  i=1i  i=1i 

S4    =       Z    TT'2  S5    =       E    KK'2  S6    =       Z     TtT'-D'! 

i=1      i  i=1      i  1  =  1  «-      i      iJ 
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S7  =   E  rD'-KK'l      and      S8  =   I  [tT'«KK'1 
i=Ui   iJ  i=1«-  i    iJ 

From  the  data  for  cases  01  through  17  and  22  through  29, 
the  following  values  for  a,  b,  and  c  were  obtained: 

a  =  0.20  a  =  -0.080  b  =  -1.028  c  =  0.129 
a  =  0.10  a  =  -0.386  b  =  -1.200  c  =  0.033 
a  =  0.05    a  =  -1.038     b  =  -1.279     c  =  -0.043 

An   approximate   coefficient   of    determination    was 
calculated  by  defining 

c/b 

TM  =  TT«KK 

so  that 

b 
D  =  a«TM 

which   is  the  inverse  power  curve  model  and  the  two  variable 

procedure  of  Section  B  can  be   used.    This   yielded   an   r2 

value   of   0.626  for  a  -  0.2,   which  shows  no  improvement  of 

fit  for  the  three  variable  approach. 

Appendix   D  lists  TM  values  for  a  =  0.2  for  information. 


D.   REGRESSION  OF  STANDARD  DEVIATION 


Examination  of  the  sample  standard  deviation  values 
listed  in  Appendix  D  also  suggests  that  the  power  curve  form 
would  be  appropriate  to  model  the  standard  deviation  on  TT. 

b 
S.D.  =  a«TT 

Proceeding  as  in  Section  B,  the  following  values  are 
obtained: 
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a  =  0.20  a  =  0.094  b  =  -0.300  r2  =  0.523 

a  =  0.10  a  =  0.075  b  =  -0.219  r2  =  0.374 

a  =  0.05  a  =  0.072  b  =  -0.215  r2  =  0.408 

which  indicates  a  poor  fit  at  best. 

However,  the  data  suggests  that  the  sample  standard 
deviation  may  be  better  predicted  as  a  function  of  the 
number  of  component  tests,  i.e. 

b 
S.D.  =  a«N 

where  N  represents  the  "equivalent"  number  of  system   tests 
as  derived  in  Section  IV. B. 2  for  use  in  Equation  (4.3)  . 

The  regression  yields  the  following  values: 

a  =  0.20  a  =  0.213  b  =  -0.391  r2  =  0.853 
a  =  0.10  a  =  0.186  b  =  -0.365  r2  =  0.825 
a  =  0.05      a  =  0.164     b  =  -0.339     r2  =  0.799 

This  fit  is  better  and  implies  that  the  primary  mechanism  to 

reduce   the   sample   standard  deviation   is  to  increase  the 

number  of  component  tests.   As  the   data   base   is   limited, 

little   more   than   that   may  be   averred   at  this  level  of 
analysis. 
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APPENDIX  F 


COMPUTER  PROGRAM 


The  following  pages  contain  a  representative  listing  of 
the  main  computer  program  utilized  in  the  simulation.  Three 
proprietary  routines  were  used  for  binomial  random  variate 
generation  (GGBIN) ,  inverse  Chi-Square  value  determination 
(MDCHI) ,  and  ordering  of  the  estimate  arrays  (VSORTA) . 
Reference  4  provides  information  concerning  the  contents  and 
use  of  these  routines.  Equivalent  routines  could  be  used 
without  penalty  to  either  accyracy  or  consistence  of  the 
simulation  results. 

The  program  was  written  in  the  FORTRAN  IV  language  for 
use  on  the  IBM-360  computer  system  installed  at  the  Naval 
Postgraduate  School. 

Portions  of  the  program  must  be  changed  as  the 
subassembly  configurations  are  varied  in  order  to  tailor  the 
computations  to  the  specific  system  being  modeled. 
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